/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0528 11:22:55.051213  1351 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:37559 successful.
I0528 11:22:55.536595  1351 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 3 ring id: 0
W0528 11:22:57.331815  1351 device_context.cc:404] Please NOTE: device: 3, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0528 11:22:57.336872  1351 device_context.cc:422] device: 3, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.42s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
  0%|          | 0/139208 [00:00<?, ?KB/s]  0%|          | 21/139208 [00:00<13:00, 178.24KB/s]  0%|          | 61/139208 [00:00<07:56, 291.72KB/s]  0%|          | 99/139208 [00:00<11:30, 201.55KB/s]  0%|          | 307/139208 [00:00<03:18, 701.51KB/s]  0%|          | 398/139208 [00:00<03:14, 712.62KB/s]  0%|          | 499/139208 [00:00<02:56, 788.04KB/s]  0%|          | 611/139208 [00:00<02:47, 826.41KB/s]  1%|          | 739/139208 [00:01<02:27, 938.03KB/s]  1%|          | 899/139208 [00:01<02:11, 1055.20KB/s]  1%|          | 1059/139208 [00:01<01:56, 1189.17KB/s]  1%|          | 1267/139208 [00:01<01:42, 1350.46KB/s]  1%|          | 1459/139208 [00:01<01:33, 1478.30KB/s]  1%|          | 1731/139208 [00:01<01:20, 1715.13KB/s]  1%|▏         | 1987/139208 [00:01<01:12, 1902.34KB/s]  2%|▏         | 2307/139208 [00:01<01:04, 2130.04KB/s]  2%|▏         | 2627/139208 [00:01<00:57, 2370.95KB/s]  2%|▏         | 3043/139208 [00:02<00:49, 2724.61KB/s]  2%|▏         | 3459/139208 [00:02<00:44, 3049.73KB/s]  3%|▎         | 3955/139208 [00:02<00:37, 3567.50KB/s]  3%|▎         | 4419/139208 [00:02<00:35, 3768.34KB/s]  4%|▎         | 4979/139208 [00:02<00:31, 4282.47KB/s]  4%|▍         | 5555/139208 [00:02<00:28, 4648.48KB/s]  4%|▍         | 6195/139208 [00:02<00:25, 5119.65KB/s]  5%|▍         | 6712/139208 [00:02<00:30, 4325.48KB/s]  5%|▌         | 7619/139208 [00:02<00:23, 5498.77KB/s]  6%|▌         | 8201/139208 [00:03<00:24, 5429.77KB/s]  6%|▋         | 8766/139208 [00:03<00:24, 5369.37KB/s]  7%|▋         | 9318/139208 [00:03<00:24, 5390.66KB/s]  7%|▋         | 9891/139208 [00:03<00:23, 5445.76KB/s]  8%|▊         | 10467/139208 [00:03<00:23, 5528.60KB/s]  8%|▊         | 11043/139208 [00:03<00:23, 5539.22KB/s]  8%|▊         | 11619/139208 [00:03<00:22, 5594.25KB/s]  9%|▉         | 12238/139208 [00:03<00:22, 5768.45KB/s]  9%|▉         | 12818/139208 [00:03<00:21, 5755.68KB/s] 10%|▉         | 13400/139208 [00:03<00:21, 5774.28KB/s] 10%|█         | 13979/139208 [00:04<00:21, 5717.11KB/s] 10%|█         | 14560/139208 [00:04<00:21, 5744.20KB/s] 11%|█         | 15136/139208 [00:04<00:21, 5731.14KB/s] 11%|█▏        | 15715/139208 [00:04<00:21, 5700.99KB/s] 12%|█▏        | 16297/139208 [00:04<00:21, 5735.82KB/s] 12%|█▏        | 16871/139208 [00:04<00:21, 5721.52KB/s] 13%|█▎        | 17444/139208 [00:04<00:21, 5708.09KB/s] 13%|█▎        | 18019/139208 [00:04<00:21, 5718.89KB/s] 13%|█▎        | 18611/139208 [00:04<00:21, 5723.08KB/s] 14%|█▍        | 19195/139208 [00:05<00:20, 5757.67KB/s] 14%|█▍        | 19795/139208 [00:05<00:20, 5725.46KB/s] 15%|█▍        | 20368/139208 [00:05<00:24, 4787.85KB/s] 15%|█▌        | 21203/139208 [00:05<00:20, 5705.62KB/s] 16%|█▌        | 21805/139208 [00:05<00:21, 5508.90KB/s] 16%|█▌        | 22379/139208 [00:05<00:22, 5291.44KB/s] 16%|█▋        | 22925/139208 [00:05<00:22, 5235.06KB/s] 17%|█▋        | 23460/139208 [00:05<00:22, 5231.82KB/s] 17%|█▋        | 23991/139208 [00:05<00:22, 5156.98KB/s] 18%|█▊        | 24531/139208 [00:06<00:21, 5216.11KB/s] 18%|█▊        | 25057/139208 [00:06<00:22, 5124.72KB/s] 18%|█▊        | 25635/139208 [00:06<00:21, 5294.37KB/s] 19%|█▉        | 26168/139208 [00:06<00:21, 5252.97KB/s] 19%|█▉        | 26723/139208 [00:06<00:21, 5272.65KB/s] 20%|█▉        | 27252/139208 [00:06<00:21, 5255.61KB/s] 20%|██        | 27843/139208 [00:06<00:20, 5432.08KB/s] 20%|██        | 28388/139208 [00:06<00:20, 5410.01KB/s] 21%|██        | 28947/139208 [00:06<00:20, 5393.88KB/s] 21%|██        | 29487/139208 [00:06<00:20, 5389.21KB/s] 22%|██▏       | 30027/139208 [00:07<00:20, 5267.58KB/s] 22%|██▏       | 30555/139208 [00:07<00:21, 5094.25KB/s] 22%|██▏       | 31139/139208 [00:07<00:20, 5224.97KB/s] 23%|██▎       | 31683/139208 [00:07<00:20, 5240.79KB/s] 23%|██▎       | 32208/139208 [00:07<00:20, 5208.23KB/s] 24%|██▎       | 32730/139208 [00:07<00:24, 4418.83KB/s] 24%|██▍       | 33203/139208 [00:07<00:23, 4447.65KB/s] 24%|██▍       | 33663/139208 [00:07<00:24, 4360.32KB/s] 25%|██▍       | 34109/139208 [00:07<00:25, 4114.59KB/s] 25%|██▍       | 34529/139208 [00:08<00:28, 3629.45KB/s] 25%|██▌       | 34906/139208 [00:08<00:30, 3379.95KB/s] 25%|██▌       | 35255/139208 [00:08<00:31, 3309.54KB/s] 26%|██▌       | 35593/139208 [00:08<00:32, 3187.34KB/s] 26%|██▌       | 35916/139208 [00:08<00:32, 3157.90KB/s] 26%|██▌       | 36259/139208 [00:08<00:31, 3219.54KB/s] 26%|██▋       | 36584/139208 [00:08<00:31, 3222.02KB/s] 27%|██▋       | 36931/139208 [00:08<00:32, 3177.72KB/s] 27%|██▋       | 37291/139208 [00:09<00:30, 3295.82KB/s] 27%|██▋       | 37623/139208 [00:09<00:30, 3301.76KB/s] 27%|██▋       | 37955/139208 [00:09<00:30, 3289.54KB/s] 28%|██▊       | 38285/139208 [00:09<00:30, 3280.35KB/s] 28%|██▊       | 38627/139208 [00:09<00:30, 3265.66KB/s] 28%|██▊       | 38973/139208 [00:09<00:30, 3322.16KB/s] 28%|██▊       | 39315/139208 [00:09<00:29, 3341.64KB/s] 28%|██▊       | 39666/139208 [00:09<00:29, 3391.13KB/s] 29%|██▊       | 40006/139208 [00:09<00:29, 3340.93KB/s] 29%|██▉       | 40371/139208 [00:09<00:29, 3325.67KB/s] 29%|██▉       | 40741/139208 [00:10<00:28, 3433.78KB/s] 30%|██▉       | 41085/139208 [00:10<00:28, 3430.29KB/s] 30%|██▉       | 41475/139208 [00:10<00:27, 3541.79KB/s] 30%|███       | 41830/139208 [00:10<00:29, 3283.68KB/s] 30%|███       | 42259/139208 [00:10<00:27, 3547.55KB/s] 31%|███       | 42659/139208 [00:10<00:28, 3411.46KB/s] 31%|███       | 43027/139208 [00:10<00:27, 3477.31KB/s] 31%|███       | 43379/139208 [00:10<00:28, 3416.65KB/s] 31%|███▏      | 43758/139208 [00:10<00:27, 3521.49KB/s] 32%|███▏      | 44163/139208 [00:11<00:25, 3671.27KB/s] 32%|███▏      | 44563/139208 [00:11<00:25, 3680.58KB/s] 32%|███▏      | 44947/139208 [00:11<00:25, 3684.72KB/s] 33%|███▎      | 45379/139208 [00:11<00:24, 3860.99KB/s] 33%|███▎      | 45779/139208 [00:11<00:24, 3885.20KB/s] 33%|███▎      | 46195/139208 [00:11<00:23, 3901.00KB/s] 33%|███▎      | 46586/139208 [00:11<00:24, 3831.99KB/s] 34%|███▍      | 47039/139208 [00:11<00:22, 4034.72KB/s] 34%|███▍      | 47444/139208 [00:11<00:23, 3844.24KB/s] 34%|███▍      | 47853/139208 [00:11<00:23, 3913.86KB/s] 35%|███▍      | 48259/139208 [00:12<00:23, 3878.73KB/s] 35%|███▍      | 48703/139208 [00:12<00:22, 4040.33KB/s] 35%|███▌      | 49109/139208 [00:12<00:22, 4026.64KB/s] 36%|███▌      | 49539/139208 [00:12<00:21, 4103.88KB/s] 36%|███▌      | 49955/139208 [00:12<00:21, 4117.79KB/s] 36%|███▌      | 50371/139208 [00:12<00:21, 4121.50KB/s] 36%|███▋      | 50803/139208 [00:12<00:21, 4136.88KB/s] 37%|███▋      | 51283/139208 [00:12<00:20, 4311.72KB/s] 37%|███▋      | 51731/139208 [00:12<00:20, 4279.06KB/s] 37%|███▋      | 52195/139208 [00:12<00:19, 4360.38KB/s] 38%|███▊      | 52643/139208 [00:13<00:19, 4390.67KB/s] 38%|███▊      | 53107/139208 [00:13<00:19, 4457.39KB/s] 38%|███▊      | 53587/139208 [00:13<00:19, 4504.53KB/s] 39%|███▉      | 54067/139208 [00:13<00:18, 4533.19KB/s] 39%|███▉      | 54537/139208 [00:13<00:18, 4582.13KB/s] 40%|███▉      | 54996/139208 [00:13<00:18, 4560.05KB/s] 40%|███▉      | 55491/139208 [00:13<00:17, 4660.52KB/s] 40%|████      | 55987/139208 [00:13<00:17, 4743.76KB/s] 41%|████      | 56462/139208 [00:13<00:17, 4711.87KB/s] 41%|████      | 56947/139208 [00:13<00:17, 4748.77KB/s] 41%|████▏     | 57442/139208 [00:14<00:17, 4808.24KB/s] 42%|████▏     | 57923/139208 [00:14<00:17, 4757.98KB/s] 42%|████▏     | 58403/139208 [00:14<00:17, 4735.18KB/s] 42%|████▏     | 58899/139208 [00:14<00:16, 4761.45KB/s] 43%|████▎     | 59411/139208 [00:14<00:16, 4853.29KB/s] 43%|████▎     | 59907/139208 [00:14<00:16, 4817.26KB/s] 43%|████▎     | 60435/139208 [00:14<00:16, 4881.38KB/s] 44%|████▍     | 60963/139208 [00:14<00:15, 4963.57KB/s] 44%|████▍     | 61460/139208 [00:14<00:15, 4886.86KB/s] 45%|████▍     | 62003/139208 [00:15<00:15, 4962.36KB/s] 45%|████▍     | 62531/139208 [00:15<00:15, 5043.28KB/s] 45%|████▌     | 63091/139208 [00:15<00:14, 5129.14KB/s] 46%|████▌     | 63604/139208 [00:15<00:14, 5099.56KB/s] 46%|████▌     | 64147/139208 [00:15<00:14, 5195.58KB/s] 46%|████▋     | 64667/139208 [00:15<00:14, 5163.79KB/s] 47%|████▋     | 65187/139208 [00:15<00:14, 5171.65KB/s] 47%|████▋     | 65726/139208 [00:15<00:14, 5235.81KB/s] 48%|████▊     | 66275/139208 [00:15<00:13, 5227.04KB/s] 48%|████▊     | 66798/139208 [00:15<00:13, 5214.64KB/s] 48%|████▊     | 67389/139208 [00:16<00:13, 5420.25KB/s] 49%|████▉     | 67932/139208 [00:16<00:13, 5390.12KB/s] 49%|████▉     | 68472/139208 [00:16<00:13, 5390.72KB/s] 50%|████▉     | 69012/139208 [00:16<00:16, 4217.14KB/s] 50%|█████     | 69651/139208 [00:16<00:14, 4745.74KB/s] 50%|█████     | 70164/139208 [00:16<00:15, 4476.28KB/s] 51%|█████     | 70640/139208 [00:16<00:15, 4407.71KB/s] 51%|█████     | 71100/139208 [00:16<00:15, 4392.99KB/s] 51%|█████▏    | 71553/139208 [00:16<00:15, 4404.52KB/s] 52%|█████▏    | 72003/139208 [00:17<00:15, 4389.28KB/s] 52%|█████▏    | 72449/139208 [00:17<00:15, 4344.42KB/s] 52%|█████▏    | 72894/139208 [00:17<00:15, 4373.92KB/s] 53%|█████▎    | 73363/139208 [00:17<00:15, 4364.21KB/s] 53%|█████▎    | 73811/139208 [00:17<00:14, 4380.99KB/s] 53%|█████▎    | 74323/139208 [00:17<00:14, 4507.10KB/s] 54%|█████▍    | 74867/139208 [00:17<00:13, 4720.92KB/s] 54%|█████▍    | 75347/139208 [00:17<00:13, 4601.70KB/s] 54%|█████▍    | 75859/139208 [00:17<00:13, 4735.53KB/s] 55%|█████▍    | 76387/139208 [00:18<00:12, 4837.20KB/s] 55%|█████▌    | 76931/139208 [00:18<00:12, 5002.86KB/s] 56%|█████▌    | 77433/139208 [00:18<00:12, 4923.69KB/s] 56%|█████▌    | 77955/139208 [00:18<00:12, 4957.87KB/s] 56%|█████▋    | 78499/139208 [00:18<00:11, 5079.97KB/s] 57%|█████▋    | 79091/139208 [00:18<00:11, 5313.50KB/s] 57%|█████▋    | 79624/139208 [00:18<00:11, 5173.88KB/s] 58%|█████▊    | 80148/139208 [00:18<00:11, 5192.38KB/s] 58%|█████▊    | 80707/139208 [00:18<00:11, 5304.76KB/s] 58%|█████▊    | 81267/139208 [00:18<00:10, 5388.90KB/s] 59%|█████▉    | 81807/139208 [00:19<00:10, 5258.38KB/s] 59%|█████▉    | 82371/139208 [00:19<00:10, 5352.34KB/s] 60%|█████▉    | 82931/139208 [00:19<00:10, 5388.37KB/s] 60%|█████▉    | 83471/139208 [00:19<00:10, 5146.32KB/s] 60%|██████    | 83989/139208 [00:19<00:10, 5152.00KB/s] 61%|██████    | 84531/139208 [00:19<00:10, 5209.57KB/s] 61%|██████    | 85144/139208 [00:19<00:09, 5478.41KB/s] 62%|██████▏   | 85694/139208 [00:19<00:09, 5478.43KB/s] 62%|██████▏   | 86244/139208 [00:19<00:09, 5423.94KB/s] 62%|██████▏   | 86788/139208 [00:19<00:09, 5417.98KB/s] 63%|██████▎   | 87331/139208 [00:20<00:09, 5403.41KB/s] 63%|██████▎   | 87939/139208 [00:20<00:09, 5588.72KB/s] 64%|██████▎   | 88499/139208 [00:20<00:09, 5498.23KB/s] 64%|██████▍   | 89059/139208 [00:20<00:09, 5500.82KB/s] 64%|██████▍   | 89619/139208 [00:20<00:09, 5449.65KB/s] 65%|██████▍   | 90195/139208 [00:20<00:08, 5534.79KB/s] 65%|██████▌   | 90755/139208 [00:20<00:08, 5537.98KB/s] 66%|██████▌   | 91347/139208 [00:20<00:08, 5629.78KB/s] 66%|██████▌   | 91915/139208 [00:20<00:08, 5643.97KB/s] 66%|██████▋   | 92480/139208 [00:21<00:08, 5590.69KB/s] 67%|██████▋   | 93040/139208 [00:21<00:08, 5461.46KB/s] 67%|██████▋   | 93635/139208 [00:21<00:08, 5578.33KB/s] 68%|██████▊   | 94195/139208 [00:21<00:08, 5510.35KB/s] 68%|██████▊   | 94755/139208 [00:21<00:08, 5470.63KB/s] 68%|██████▊   | 95331/139208 [00:21<00:07, 5513.37KB/s] 69%|██████▉   | 95907/139208 [00:21<00:07, 5584.77KB/s] 69%|██████▉   | 96483/139208 [00:21<00:07, 5515.31KB/s] 70%|██████▉   | 97043/139208 [00:21<00:07, 5512.18KB/s] 70%|███████   | 97651/139208 [00:21<00:07, 5647.77KB/s] 71%|███████   | 98243/139208 [00:22<00:07, 5719.79KB/s] 71%|███████   | 98816/139208 [00:22<00:07, 5721.44KB/s] 71%|███████▏  | 99389/139208 [00:22<00:07, 5620.93KB/s] 72%|███████▏  | 99959/139208 [00:22<00:06, 5643.27KB/s] 72%|███████▏  | 100570/139208 [00:22<00:06, 5781.11KB/s] 73%|███████▎  | 101155/139208 [00:22<00:06, 5792.49KB/s] 73%|███████▎  | 101735/139208 [00:22<00:06, 5749.04KB/s] 74%|███████▎  | 102323/139208 [00:22<00:06, 5738.57KB/s] 74%|███████▍  | 102899/139208 [00:22<00:06, 5737.68KB/s] 74%|███████▍  | 103491/139208 [00:22<00:06, 5766.65KB/s] 75%|███████▍  | 104068/139208 [00:23<00:06, 5717.92KB/s] 75%|███████▌  | 104643/139208 [00:23<00:06, 5717.16KB/s] 76%|███████▌  | 105219/139208 [00:23<00:05, 5723.72KB/s] 76%|███████▌  | 105795/139208 [00:23<00:05, 5724.54KB/s] 76%|███████▋  | 106375/139208 [00:23<00:05, 5746.01KB/s] 77%|███████▋  | 106950/139208 [00:23<00:05, 5731.82KB/s] 77%|███████▋  | 107524/139208 [00:23<00:05, 5720.80KB/s] 78%|███████▊  | 108099/139208 [00:23<00:05, 5720.13KB/s] 78%|███████▊  | 108691/139208 [00:23<00:05, 5751.11KB/s] 78%|███████▊  | 109267/139208 [00:23<00:05, 5722.04KB/s] 79%|███████▉  | 109859/139208 [00:24<00:05, 5733.26KB/s] 79%|███████▉  | 110435/139208 [00:24<00:05, 5730.00KB/s] 80%|███████▉  | 111011/139208 [00:24<00:04, 5737.69KB/s] 80%|████████  | 111585/139208 [00:24<00:05, 4641.79KB/s] 81%|████████  | 112403/139208 [00:24<00:04, 5546.85KB/s] 81%|████████  | 112997/139208 [00:24<00:05, 5131.50KB/s] 82%|████████▏ | 113542/139208 [00:24<00:05, 5034.64KB/s] 82%|████████▏ | 114068/139208 [00:24<00:05, 4816.32KB/s] 82%|████████▏ | 114643/139208 [00:25<00:04, 5047.47KB/s] 83%|████████▎ | 115162/139208 [00:25<00:04, 5072.12KB/s] 83%|████████▎ | 115680/139208 [00:25<00:04, 4967.21KB/s] 83%|████████▎ | 116196/139208 [00:25<00:04, 5020.61KB/s] 84%|████████▍ | 116787/139208 [00:25<00:04, 5258.69KB/s] 84%|████████▍ | 117331/139208 [00:25<00:04, 5296.86KB/s] 85%|████████▍ | 117907/139208 [00:25<00:03, 5329.18KB/s] 85%|████████▌ | 118455/139208 [00:25<00:03, 5372.39KB/s] 86%|████████▌ | 119043/139208 [00:25<00:03, 5516.16KB/s] 86%|████████▌ | 119635/139208 [00:25<00:03, 5632.14KB/s] 86%|████████▋ | 120200/139208 [00:26<00:03, 5624.85KB/s] 87%|████████▋ | 120764/139208 [00:26<00:03, 5556.15KB/s] 87%|████████▋ | 121321/139208 [00:26<00:03, 5515.77KB/s] 88%|████████▊ | 121939/139208 [00:26<00:03, 5651.81KB/s] 88%|████████▊ | 122515/139208 [00:26<00:02, 5683.12KB/s] 88%|████████▊ | 123104/139208 [00:26<00:02, 5743.90KB/s] 89%|████████▉ | 123681/139208 [00:26<00:02, 5750.32KB/s] 89%|████████▉ | 124257/139208 [00:26<00:02, 5705.30KB/s] 90%|████████▉ | 124835/139208 [00:26<00:02, 5695.47KB/s] 90%|█████████ | 125427/139208 [00:26<00:02, 5694.84KB/s] 91%|█████████ | 126003/139208 [00:27<00:02, 5701.56KB/s] 91%|█████████ | 126593/139208 [00:27<00:02, 5759.94KB/s] 91%|█████████▏| 127170/139208 [00:27<00:02, 5744.62KB/s] 92%|█████████▏| 127745/139208 [00:27<00:01, 5741.54KB/s] 92%|█████████▏| 128320/139208 [00:27<00:01, 5735.65KB/s] 93%|█████████▎| 128894/139208 [00:27<00:01, 5691.80KB/s] 93%|█████████▎| 129464/139208 [00:27<00:01, 5590.03KB/s] 93%|█████████▎| 130024/139208 [00:27<00:01, 5580.27KB/s] 94%|█████████▍| 130659/139208 [00:27<00:01, 5795.21KB/s] 94%|█████████▍| 131239/139208 [00:27<00:01, 5767.12KB/s] 95%|█████████▍| 131827/139208 [00:28<00:01, 5733.63KB/s] 95%|█████████▌| 132419/139208 [00:28<00:01, 5732.88KB/s] 96%|█████████▌| 132995/139208 [00:28<00:01, 5733.49KB/s] 96%|█████████▌| 133571/139208 [00:28<00:00, 5718.91KB/s] 96%|█████████▋| 134147/139208 [00:28<00:00, 5730.41KB/s] 97%|█████████▋| 134739/139208 [00:28<00:00, 5759.34KB/s] 97%|█████████▋| 135315/139208 [00:28<00:00, 5714.34KB/s] 98%|█████████▊| 135891/139208 [00:28<00:00, 5720.08KB/s] 98%|█████████▊| 136467/139208 [00:28<00:00, 5730.07KB/s] 98%|█████████▊| 137043/139208 [00:29<00:00, 5728.01KB/s] 99%|█████████▉| 137635/139208 [00:29<00:00, 5757.68KB/s] 99%|█████████▉| 138211/139208 [00:29<00:00, 5717.70KB/s]100%|█████████▉| 138803/139208 [00:29<00:00, 5722.14KB/s]100%|██████████| 139208/139208 [00:29<00:00, 4737.19KB/s]
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 80, in _forward
    rois, rois_num, rpn_loss = self.rpn_head(body_feats, self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/proposal_generator/rpn_head.py", line 120, in forward
    loss = self.get_loss(scores, deltas, anchors, inputs)
  File "/home/lthpc/clw/ppdet/modeling/proposal_generator/rpn_head.py", line 200, in get_loss
    anchors)
  File "/home/lthpc/clw/ppdet/modeling/proposal_generator/target_layer.py", line 48, in __call__
    batch_size)
  File "/home/lthpc/clw/ppdet/modeling/proposal_generator/target.py", line 52, in rpn_anchor_target
    tgt_delta = bbox2delta(anchors, matched_gt_boxes, weights)
  File "/home/lthpc/clw/ppdet/modeling/bbox_utils.py", line 33, in bbox2delta
    dw = ww * paddle.log(tgt_w / src_w)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/math_op_patch.py", line 250, in __impl__
    return math_op(self, other_var, 'axis', axis)
KeyboardInterrupt
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0528 11:54:45.999917 44424 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:45549 successful.
I0528 11:54:46.087013 44424 nccl_context.cc:74] init nccl context nranks: 6 local rank: 3 gpu id: 7 ring id: 0
W0528 11:54:49.636363 44424 device_context.cc:404] Please NOTE: device: 7, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0528 11:54:49.644188 44424 device_context.cc:422] device: 7, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.45s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
ERROR:root:DataLoader reader thread raised an exception!
Exception in thread Thread-3:
Traceback (most recent call last):
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dataloader/dataloader_iter.py", line 482, in _get_data
    data = self._data_queue.get(timeout=self._timeout)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/multiprocessing/queues.py", line 105, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dataloader/dataloader_iter.py", line 411, in _thread_loop
    batch = self._get_data()
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dataloader/dataloader_iter.py", line 498, in _get_data
    "pids: {}".format(len(failed_workers), pids))
RuntimeError: DataLoader 2 workers exit unexpectedly, pids: 20420, 20427

/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0528 13:03:07.334486 37725 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:59433 successful.
I0528 13:03:07.525197 37725 nccl_context.cc:74] init nccl context nranks: 6 local rank: 3 gpu id: 7 ring id: 0


--------------------------------------
C++ Traceback (most recent call last):
--------------------------------------
0   paddle::imperative::NCCLParallelContext::Init()
1   paddle::platform::NCCLCommContext::CreateNCCLComm(ncclUniqueId*, int, int, int, int)
2   ncclCommInitRank
3   paddle::framework::SignalHandle(char const*, int)
4   paddle::platform::GetCurrentTraceBackString[abi:cxx11]()

----------------------
Error Message Summary:
----------------------
FatalError: `Termination signal` is detected by the operating system.
  [TimeInfo: *** Aborted at 1622178191 (unix time) try "date -d @1622178191" if you are using GNU date ***]
  [SignalInfo: *** SIGTERM (@0x3e8000092e4) received by PID 37725 (TID 0x7fc876f16740) from PID 37604 ***]

/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0528 13:05:18.113112 40708 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:43443 successful.
I0528 13:05:18.565388 40708 nccl_context.cc:74] init nccl context nranks: 6 local rank: 3 gpu id: 7 ring id: 0
W0528 13:05:21.843827 40708 device_context.cc:404] Please NOTE: device: 7, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0528 13:05:21.853123 40708 device_context.cc:422] device: 7, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.43s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 75, in _forward
    body_feats = self.backbone(self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/resnet_v3.py", line 573, in forward
    conv1 = self.conv1(x)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/container.py", line 97, in forward
    input = layer(input)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/resnet_v3.py", line 122, in forward
    out = self.conv(inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/nn/layer/conv.py", line 667, in forward
    use_cudnn=self._use_cudnn)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/nn/functional/conv.py", line 114, in _conv_nd
    pre_bias = getattr(core.ops, op_type)(x, weight, *attrs)
KeyboardInterrupt
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0528 13:07:08.253880 44024 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:56871 successful.
I0528 13:07:08.695729 44024 nccl_context.cc:74] init nccl context nranks: 6 local rank: 3 gpu id: 7 ring id: 0
W0528 13:07:11.969039 44024 device_context.cc:404] Please NOTE: device: 7, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0528 13:07:11.977885 44024 device_context.cc:422] device: 7, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 85, in run
    trainer = Trainer(cfg, mode='train')
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 67, in __init__
    self.dataset, cfg.worker_num)
  File "/home/lthpc/clw/ppdet/data/reader.py", line 143, in __call__
    self.dataset.parse_dataset()
  File "/home/lthpc/clw/ppdet/data/source/coco.py", line 45, in parse_dataset
    coco = COCO(anno_path)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/pycocotools/coco.py", line 85, in __init__
    dataset = json.load(f)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/json/__init__.py", line 296, in load
    parse_constant=parse_constant, object_pairs_hook=object_pairs_hook, **kw)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/json/__init__.py", line 348, in loads
    return _default_decoder.decode(s)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/json/decoder.py", line 353, in raw_decode
    obj, end = self.scan_once(s, idx)
KeyboardInterrupt
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0528 13:07:29.820188 44760 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:36359 successful.
I0528 13:07:29.951786 44760 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0528 13:07:32.110796 44760 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0528 13:07:32.120512 44760 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.43s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 75, in _forward
    body_feats = self.backbone(self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/resnet_v3.py", line 573, in forward
    conv1 = self.conv1(x)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/container.py", line 97, in forward
    input = layer(input)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/resnet_v3.py", line 122, in forward
    out = self.conv(inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/nn/layer/conv.py", line 667, in forward
    use_cudnn=self._use_cudnn)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/nn/functional/conv.py", line 114, in _conv_nd
    pre_bias = getattr(core.ops, op_type)(x, weight, *attrs)
KeyboardInterrupt
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0528 13:57:36.187536 15670 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:50775 successful.
I0528 13:57:36.673182 15670 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0528 13:57:38.978080 15670 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0528 13:57:38.984148 15670 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.44s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 75, in _forward
    body_feats = self.backbone(self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/resnet_v3.py", line 577, in forward
    x = stage(x)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/resnet_v3.py", line 427, in forward
    block_out = block(block_out)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/resnet_v3.py", line 365, in forward
    out = self.branch2b(out)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/resnet_v3.py", line 122, in forward
    out = self.conv(inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/nn/layer/conv.py", line 667, in forward
    use_cudnn=self._use_cudnn)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/nn/functional/conv.py", line 114, in _conv_nd
    pre_bias = getattr(core.ops, op_type)(x, weight, *attrs)
KeyboardInterrupt
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0528 23:18:40.773839 18963 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:44421 successful.
I0528 23:18:41.326992 18963 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0528 23:18:47.237727 18963 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0528 23:18:47.245306 18963 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 85, in run
    trainer = Trainer(cfg, mode='train')
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 54, in __init__
    self.model = create(cfg.architecture)
  File "/home/lthpc/clw/ppdet/core/workspace.py", line 239, in create
    cls_kwargs.update(cls.from_config(config, **kwargs))
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 61, in from_config
    bbox_head = create(cfg['bbox_head'], **kwargs)
  File "/home/lthpc/clw/ppdet/core/workspace.py", line 268, in create
    cls_kwargs[k] = create(target_key)
  File "/home/lthpc/clw/ppdet/core/workspace.py", line 276, in create
    return cls(**cls_kwargs)
  File "/home/lthpc/clw/ppdet/modeling/losses/balanced_l1_loss_iou.py", line 40, in __init__
    super(BalancedL1Loss, self).__init__()
NameError: name 'BalancedL1Loss' is not defined
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0528 23:19:42.837059 19829 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:58359 successful.
I0528 23:19:43.709220 19829 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0528 23:19:48.334264 19829 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0528 23:19:48.340793 19829 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.43s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 82, in _forward
    self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/heads/cascade_head.py", line 219, in forward
    self.bbox_weight[stage])
  File "/home/lthpc/clw/ppdet/modeling/heads/bbox_head.py", line 382, in get_my_loss
    reg_delta, reg_target).sum() / tgt_labels.shape[0]
  File "/home/lthpc/clw/ppdet/modeling/losses/balanced_l1_loss_iou.py", line 61, in __call__
    reg_delta = self.bbox_transform(x)
  File "/home/lthpc/clw/ppdet/modeling/losses/balanced_l1_loss_iou.py", line 88, in bbox_transform
    deltas = paddle.reshape(deltas, shape=(0, -1, 4))
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/manipulation.py", line 1570, in reshape
    return paddle.fluid.layers.reshape(x=x, shape=shape, name=name)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/layers/nn.py", line 6142, in reshape
    out, _ = core.ops.reshape2(x, None, 'shape', shape)
ValueError: (InvalidArgument) The 'shape' attribute in ReshapeOp is invalid. The input tensor X'size must be divisible by known capacity of 'shape'. But received X's shape = [12], X's size = 12, 'shape' is [0, -1, 4], known capacity of 'shape' is -48.
  [Hint: Expected output_shape[unk_dim_idx] * capacity == -in_size, but received output_shape[unk_dim_idx] * capacity:0 != -in_size:-12.] (at /paddle/paddle/fluid/operators/reshape_op.cc:208)
  [operator < reshape2 > error]
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0528 23:29:40.966218 26297 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:45285 successful.
I0528 23:29:41.693753 26297 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0528 23:29:46.156790 26297 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0528 23:29:46.162710 26297 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.47s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 75, in _forward
    body_feats = self.backbone(self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/resnet_v3.py", line 577, in forward
    x = stage(x)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/resnet_v3.py", line 427, in forward
    block_out = block(block_out)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/resnet_v3.py", line 366, in forward
    out = self.branch2c(out)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/resnet_v3.py", line 133, in forward
    out = self.norm(out)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/nn.py", line 1342, in forward
    mean_out, variance_out, *attrs)
KeyboardInterrupt
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0528 23:32:28.925078 28856 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:48813 successful.
I0528 23:32:29.435214 28856 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0528 23:32:34.003787 28856 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0528 23:32:34.011370 28856 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.40s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 82, in _forward
    self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/heads/cascade_head.py", line 219, in forward
    self.bbox_weight[stage])
  File "/home/lthpc/clw/ppdet/modeling/heads/bbox_head.py", line 382, in get_my_loss
    reg_delta, reg_target).sum() / tgt_labels.shape[0]
  File "/home/lthpc/clw/ppdet/modeling/losses/balanced_l1_loss_iou.py", line 61, in __call__
    reg_delta = self.bbox_transform(x)
  File "/home/lthpc/clw/ppdet/modeling/losses/balanced_l1_loss_iou.py", line 88, in bbox_transform
    deltas = paddle.reshape(deltas, shape=(0, -1, 4))
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/manipulation.py", line 1570, in reshape
    return paddle.fluid.layers.reshape(x=x, shape=shape, name=name)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/layers/nn.py", line 6142, in reshape
    out, _ = core.ops.reshape2(x, None, 'shape', shape)
ValueError: (InvalidArgument) The 'shape' attribute in ReshapeOp is invalid. The input tensor X'size must be divisible by known capacity of 'shape'. But received X's shape = [12], X's size = 12, 'shape' is [0, -1, 4], known capacity of 'shape' is -48.
  [Hint: Expected output_shape[unk_dim_idx] * capacity == -in_size, but received output_shape[unk_dim_idx] * capacity:0 != -in_size:-12.] (at /paddle/paddle/fluid/operators/reshape_op.cc:208)
  [operator < reshape2 > error]
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0528 23:39:45.042462 33876 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:48575 successful.
I0528 23:39:45.495110 33876 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0528 23:39:50.860141 33876 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0528 23:39:50.866008 33876 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.54s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 82, in _forward
    self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/heads/cascade_head.py", line 219, in forward
    self.bbox_weight[stage])
  File "/home/lthpc/clw/ppdet/modeling/heads/bbox_head.py", line 382, in get_my_loss
    reg_delta, reg_target).sum() / tgt_labels.shape[0]
  File "/home/lthpc/clw/ppdet/modeling/losses/balanced_l1_loss_iou.py", line 61, in __call__
    reg_delta = self.bbox_transform(x)
  File "/home/lthpc/clw/ppdet/modeling/losses/balanced_l1_loss_iou.py", line 88, in bbox_transform
    deltas = paddle.reshape(deltas, shape=(0, -1, 4))
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/manipulation.py", line 1570, in reshape
    return paddle.fluid.layers.reshape(x=x, shape=shape, name=name)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/layers/nn.py", line 6142, in reshape
    out, _ = core.ops.reshape2(x, None, 'shape', shape)
ValueError: (InvalidArgument) The 'shape' attribute in ReshapeOp is invalid. The input tensor X'size must be divisible by known capacity of 'shape'. But received X's shape = [12], X's size = 12, 'shape' is [0, -1, 4], known capacity of 'shape' is -48.
  [Hint: Expected output_shape[unk_dim_idx] * capacity == -in_size, but received output_shape[unk_dim_idx] * capacity:0 != -in_size:-12.] (at /paddle/paddle/fluid/operators/reshape_op.cc:208)
  [operator < reshape2 > error]
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0528 23:41:01.835361 35258 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:49991 successful.
I0528 23:41:02.023773 35258 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0528 23:41:06.940515 35258 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0528 23:41:06.947844 35258 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.43s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 82, in _forward
    self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/heads/cascade_head.py", line 219, in forward
    self.bbox_weight[stage])
  File "/home/lthpc/clw/ppdet/modeling/heads/bbox_head.py", line 382, in get_my_loss
    reg_delta, reg_target).sum() / tgt_labels.shape[0]
  File "/home/lthpc/clw/ppdet/modeling/losses/balanced_l1_loss_iou.py", line 61, in __call__
    reg_delta = self.bbox_transform(x)
  File "/home/lthpc/clw/ppdet/modeling/losses/balanced_l1_loss_iou.py", line 88, in bbox_transform
    deltas = paddle.reshape(deltas, shape=(0, -1, 4))
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/manipulation.py", line 1570, in reshape
    return paddle.fluid.layers.reshape(x=x, shape=shape, name=name)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/layers/nn.py", line 6142, in reshape
    out, _ = core.ops.reshape2(x, None, 'shape', shape)
ValueError: (InvalidArgument) The 'shape' attribute in ReshapeOp is invalid. The input tensor X'size must be divisible by known capacity of 'shape'. But received X's shape = [12], X's size = 12, 'shape' is [0, -1, 4], known capacity of 'shape' is -48.
  [Hint: Expected output_shape[unk_dim_idx] * capacity == -in_size, but received output_shape[unk_dim_idx] * capacity:0 != -in_size:-12.] (at /paddle/paddle/fluid/operators/reshape_op.cc:208)
  [operator < reshape2 > error]
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0528 23:42:15.747969 36638 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:42711 successful.
I0528 23:42:15.807019 36638 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0528 23:42:21.502398 36638 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0528 23:42:21.512131 36638 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.45s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 82, in _forward
    self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/heads/cascade_head.py", line 219, in forward
    self.bbox_weight[stage])
  File "/home/lthpc/clw/ppdet/modeling/heads/bbox_head.py", line 382, in get_my_loss
    reg_delta, reg_target).sum() / tgt_labels.shape[0]
  File "/home/lthpc/clw/ppdet/modeling/losses/balanced_l1_loss_iou.py", line 61, in __call__
    reg_delta = self.bbox_transform(x)
  File "/home/lthpc/clw/ppdet/modeling/losses/balanced_l1_loss_iou.py", line 88, in bbox_transform
    deltas = paddle.reshape(deltas, shape=(0, -1, 4))
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/manipulation.py", line 1570, in reshape
    return paddle.fluid.layers.reshape(x=x, shape=shape, name=name)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/layers/nn.py", line 6142, in reshape
    out, _ = core.ops.reshape2(x, None, 'shape', shape)
ValueError: (InvalidArgument) The 'shape' attribute in ReshapeOp is invalid. The input tensor X'size must be divisible by known capacity of 'shape'. But received X's shape = [12], X's size = 12, 'shape' is [0, -1, 4], known capacity of 'shape' is -48.
  [Hint: Expected output_shape[unk_dim_idx] * capacity == -in_size, but received output_shape[unk_dim_idx] * capacity:0 != -in_size:-12.] (at /paddle/paddle/fluid/operators/reshape_op.cc:208)
  [operator < reshape2 > error]
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0528 23:43:22.073298 38004 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:36783 successful.
I0528 23:43:22.394953 38004 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0528 23:43:27.652704 38004 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0528 23:43:27.663789 38004 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.41s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 82, in _forward
    self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/heads/cascade_head.py", line 219, in forward
    self.bbox_weight[stage])
  File "/home/lthpc/clw/ppdet/modeling/heads/bbox_head.py", line 382, in get_my_loss
    reg_delta, reg_target).sum() / tgt_labels.shape[0]
  File "/home/lthpc/clw/ppdet/modeling/losses/balanced_l1_loss_iou.py", line 61, in __call__
    reg_delta = self.bbox_transform(x)
  File "/home/lthpc/clw/ppdet/modeling/losses/balanced_l1_loss_iou.py", line 88, in bbox_transform
    deltas = paddle.reshape(deltas, shape=(0, -1, 4))
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/manipulation.py", line 1570, in reshape
    return paddle.fluid.layers.reshape(x=x, shape=shape, name=name)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/layers/nn.py", line 6142, in reshape
    out, _ = core.ops.reshape2(x, None, 'shape', shape)
ValueError: (InvalidArgument) The 'shape' attribute in ReshapeOp is invalid. The input tensor X'size must be divisible by known capacity of 'shape'. But received X's shape = [12], X's size = 12, 'shape' is [0, -1, 4], known capacity of 'shape' is -48.
  [Hint: Expected output_shape[unk_dim_idx] * capacity == -in_size, but received output_shape[unk_dim_idx] * capacity:0 != -in_size:-12.] (at /paddle/paddle/fluid/operators/reshape_op.cc:208)
  [operator < reshape2 > error]
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0528 23:44:34.801852 39320 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:44023 successful.
I0528 23:44:35.008441 39320 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0528 23:44:40.972224 39320 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0528 23:44:40.983158 39320 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.44s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 82, in _forward
    self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/heads/cascade_head.py", line 219, in forward
    self.bbox_weight[stage])
  File "/home/lthpc/clw/ppdet/modeling/heads/bbox_head.py", line 377, in get_my_loss
    loss_bbox_reg = self.bbox_loss(reg_delta, reg_target).sum() / tgt_labels.shape[0]
  File "/home/lthpc/clw/ppdet/modeling/losses/balanced_l1_loss_iou.py", line 64, in __call__
    diff = self.iou_loss(reg_delta,reg_target)
TypeError: 'str' object is not callable
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0528 23:47:21.063917 41787 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:59711 successful.
I0528 23:47:21.282017 41787 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0528 23:47:26.303732 41787 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0528 23:47:26.312292 41787 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.44s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 75, in _forward
    body_feats = self.backbone(self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/res2net.py", line 421, in forward
    res1 = self.res1(x)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/container.py", line 97, in forward
    input = layer(input)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/res2net.py", line 116, in forward
    out = self.conv(inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/nn/layer/conv.py", line 667, in forward
    use_cudnn=self._use_cudnn)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/nn/functional/conv.py", line 114, in _conv_nd
    pre_bias = getattr(core.ops, op_type)(x, weight, *attrs)
KeyboardInterrupt
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0529 09:21:32.666098  8970 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:50593 successful.
I0529 09:21:33.390309  8970 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0529 09:21:39.186794  8970 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0529 09:21:39.196995  8970 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.42s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 75, in _forward
    body_feats = self.backbone(self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/res2net.py", line 421, in forward
    res1 = self.res1(x)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/container.py", line 97, in forward
    input = layer(input)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/res2net.py", line 116, in forward
    out = self.conv(inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/nn/layer/conv.py", line 667, in forward
    use_cudnn=self._use_cudnn)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/nn/functional/conv.py", line 114, in _conv_nd
    pre_bias = getattr(core.ops, op_type)(x, weight, *attrs)
KeyboardInterrupt
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0529 14:54:36.985117 24564 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:49805 successful.
I0529 14:54:37.359791 24564 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0529 14:54:42.729207 24564 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0529 14:54:42.735116 24564 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.47s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 82, in _forward
    self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/heads/cascade_head.py", line 219, in forward
    self.bbox_weight[stage])
  File "/home/lthpc/clw/ppdet/modeling/heads/bbox_head.py", line 388, in get_my_loss
    loss_bbox[reg_name] = loss_bbox_reg
UnboundLocalError: local variable 'loss_bbox_reg' referenced before assignment
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0529 14:56:31.774523 26301 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:47405 successful.
I0529 14:56:31.883980 26301 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0529 14:56:36.475308 26301 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0529 14:56:36.483331 26301 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.42s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0530 09:13:29.458163 40037 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:34863 successful.
I0530 09:13:29.765429 40037 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0530 09:13:32.114897 40037 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0530 09:13:32.122726 40037 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.41s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
ERROR:root:DataLoader reader thread raised an exception!
Exception in thread Thread-3:
Traceback (most recent call last):
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dataloader/dataloader_iter.py", line 482, in _get_data
    data = self._data_queue.get(timeout=self._timeout)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/multiprocessing/queues.py", line 105, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dataloader/dataloader_iter.py", line 411, in _thread_loop
    batch = self._get_data()
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dataloader/dataloader_iter.py", line 498, in _get_data
    "pids: {}".format(len(failed_workers), pids))
RuntimeError: DataLoader 2 workers exit unexpectedly, pids: 43131, 43140

/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0530 10:32:01.858551 43971 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:47151 successful.
I0530 10:32:01.907291 43971 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0530 10:32:03.850270 43971 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0530 10:32:03.854748 43971 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.40s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.


--------------------------------------
C++ Traceback (most recent call last):
--------------------------------------
0   paddle::imperative::Tracer::TraceOp(std::string const&, paddle::imperative::NameVarBaseMap const&, paddle::imperative::NameVarBaseMap const&, paddle::framework::AttributeMap, std::map<std::string, std::string, std::less<std::string >, std::allocator<std::pair<std::string const, std::string > > > const&)
1   paddle::imperative::Tracer::TraceOp(std::string const&, paddle::imperative::NameVarBaseMap const&, paddle::imperative::NameVarBaseMap const&, paddle::framework::AttributeMap, paddle::platform::Place const&, bool, std::map<std::string, std::string, std::less<std::string >, std::allocator<std::pair<std::string const, std::string > > > const&)
2   std::shared_ptr<paddle::imperative::details::NameVarMapTrait<paddle::imperative::VarBase>::Type> paddle::imperative::PrepareData<paddle::imperative::VarBase>(paddle::framework::OperatorWithKernel const&, paddle::imperative::details::NameVarMapTrait<paddle::imperative::VarBase>::Type const&, paddle::framework::OpKernelType const&)
3   paddle::framework::TransformData(paddle::framework::OpKernelType const&, paddle::framework::OpKernelType const&, paddle::framework::Tensor const&, paddle::framework::Tensor*)
4   paddle::framework::TransDataDevice(paddle::framework::Tensor const&, paddle::platform::Place const&, paddle::framework::Tensor*)
5   paddle::framework::TensorCopySync(paddle::framework::Tensor const&, paddle::platform::Place const&, paddle::framework::Tensor*)
6   void paddle::memory::Copy<paddle::platform::CUDAPlace, paddle::platform::CUDAPinnedPlace>(paddle::platform::CUDAPlace, void*, paddle::platform::CUDAPinnedPlace, void const*, unsigned long, CUstream_st*)
7   paddle::platform::GpuMemcpySync(void*, void const*, unsigned long, cudaMemcpyKind)
8   paddle::framework::SignalHandle(char const*, int)
9   paddle::platform::GetCurrentTraceBackString[abi:cxx11]()

----------------------
Error Message Summary:
----------------------
FatalError: `Termination signal` is detected by the operating system.
  [TimeInfo: *** Aborted at 1622341944 (unix time) try "date -d @1622341944" if you are using GNU date ***]
  [SignalInfo: *** SIGTERM (@0x3e80000ab74) received by PID 43971 (TID 0x7fa101423740) from PID 43892 ***]

/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0530 10:33:27.887871 44483 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:49311 successful.
I0530 10:33:28.382244 44483 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0530 10:33:30.743767 44483 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0530 10:33:30.749433 44483 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.41s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 75, in _forward
    body_feats = self.backbone(self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/res2net.py", line 421, in forward
    res1 = self.res1(x)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/container.py", line 97, in forward
    input = layer(input)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/res2net.py", line 116, in forward
    out = self.conv(inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/nn/layer/conv.py", line 667, in forward
    use_cudnn=self._use_cudnn)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/nn/functional/conv.py", line 114, in _conv_nd
    pre_bias = getattr(core.ops, op_type)(x, weight, *attrs)
KeyboardInterrupt
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0530 10:58:53.430356 45245 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:46759 successful.
I0530 10:58:53.788774 45245 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0530 10:58:56.092875 45245 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0530 10:58:56.103111 45245 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.41s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 80, in _forward
    rois, rois_num, rpn_loss = self.rpn_head(body_feats, self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/proposal_generator/rpn_head.py", line 109, in forward
    anchors = self.anchor_generator(rpn_feats)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/proposal_generator/anchor_generator.py", line 100, in forward
    anchors_over_all_feature_maps = self._grid_anchors(grid_sizes)
  File "/home/lthpc/clw/ppdet/modeling/proposal_generator/anchor_generator.py", line 89, in _grid_anchors
    self.offset)
  File "/home/lthpc/clw/ppdet/modeling/proposal_generator/anchor_generator.py", line 78, in _create_grid_offsets
    offset * stride, grid_height * stride, step=stride, dtype='float32')
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/math_op_patch.py", line 206, in __impl__
    return scalar_method(self, other_var)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/math_op_patch.py", line 169, in _scalar_mul_
    return _scalar_elementwise_op_(var, value, 0.0)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/math_op_patch.py", line 109, in _scalar_elementwise_op_
    return core.ops.scale(var, 'scale', scale, 'bias', bias)
KeyboardInterrupt
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0530 11:04:30.570283 45904 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:51263 successful.
I0530 11:04:30.639437 45904 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0530 11:04:32.756520 45904 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0530 11:04:32.762421 45904 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.41s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 302, in train
    loss.backward()
  File "<decorator-gen-123>", line 2, in backward
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/wrapped_decorator.py", line 25, in __impl__
    return wrapped_func(*args, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/framework.py", line 225, in __impl__
    return func(*args, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/varbase_patch_methods.py", line 236, in backward
    framework._dygraph_tracer())
KeyboardInterrupt
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0530 11:44:56.635672 47123 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:48981 successful.
I0530 11:44:56.769747 47123 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 8 ring id: 0
W0530 11:45:00.775214 47123 device_context.cc:404] Please NOTE: device: 8, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0530 11:45:00.779290 47123 device_context.cc:422] device: 8, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.45s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.


--------------------------------------
C++ Traceback (most recent call last):
--------------------------------------
0   paddle::imperative::Tracer::TraceOp(std::string const&, paddle::imperative::NameVarBaseMap const&, paddle::imperative::NameVarBaseMap const&, paddle::framework::AttributeMap, std::map<std::string, std::string, std::less<std::string >, std::allocator<std::pair<std::string const, std::string > > > const&)
1   paddle::imperative::Tracer::TraceOp(std::string const&, paddle::imperative::NameVarBaseMap const&, paddle::imperative::NameVarBaseMap const&, paddle::framework::AttributeMap, paddle::platform::Place const&, bool, std::map<std::string, std::string, std::less<std::string >, std::allocator<std::pair<std::string const, std::string > > > const&)
2   std::shared_ptr<paddle::imperative::details::NameVarMapTrait<paddle::imperative::VarBase>::Type> paddle::imperative::PrepareData<paddle::imperative::VarBase>(paddle::framework::OperatorWithKernel const&, paddle::imperative::details::NameVarMapTrait<paddle::imperative::VarBase>::Type const&, paddle::framework::OpKernelType const&)
3   paddle::framework::TransformData(paddle::framework::OpKernelType const&, paddle::framework::OpKernelType const&, paddle::framework::Tensor const&, paddle::framework::Tensor*)
4   paddle::framework::TransDataDevice(paddle::framework::Tensor const&, paddle::platform::Place const&, paddle::framework::Tensor*)
5   paddle::framework::TensorCopySync(paddle::framework::Tensor const&, paddle::platform::Place const&, paddle::framework::Tensor*)
6   void paddle::memory::Copy<paddle::platform::CUDAPlace, paddle::platform::CUDAPinnedPlace>(paddle::platform::CUDAPlace, void*, paddle::platform::CUDAPinnedPlace, void const*, unsigned long, CUstream_st*)
7   paddle::platform::GpuMemcpySync(void*, void const*, unsigned long, cudaMemcpyKind)
8   paddle::framework::SignalHandle(char const*, int)
9   paddle::platform::GetCurrentTraceBackString[abi:cxx11]()

----------------------
Error Message Summary:
----------------------
FatalError: `Termination signal` is detected by the operating system.
  [TimeInfo: *** Aborted at 1622346316 (unix time) try "date -d @1622346316" if you are using GNU date ***]
  [SignalInfo: *** SIGTERM (@0x3e80000b7c4) received by PID 47123 (TID 0x7f3b0664d740) from PID 47044 ***]

/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0530 11:46:38.033496 47764 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:53615 successful.
I0530 11:46:38.050840 47764 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 8 ring id: 0
W0530 11:46:42.199563 47764 device_context.cc:404] Please NOTE: device: 8, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0530 11:46:42.203536 47764 device_context.cc:422] device: 8, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.40s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 75, in _forward
    body_feats = self.backbone(self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/res2net.py", line 425, in forward
    x = stage(x)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/res2net.py", line 285, in forward
    return self.blocks(inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/container.py", line 97, in forward
    input = layer(input)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/res2net.py", line 242, in forward
    out = paddle.add(out, short)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/math.py", line 239, in add
    x, y, axis=axis, op_name=op_type)
  File "<decorator-gen-136>", line 2, in _elementwise_op_in_dygraph
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/wrapped_decorator.py", line 25, in __impl__
    return wrapped_func(*args, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/framework.py", line 225, in __impl__
    return func(*args, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/math.py", line 179, in _elementwise_op_in_dygraph
    out = op(x, y, 'axis', axis, 'use_mkldnn', use_mkldnn)
SystemError: (Fatal) Operator elementwise_add raises an paddle::memory::allocation::BadAlloc exception.
The exception content is
:ResourceExhaustedError: 

Out of memory error on GPU 8. Cannot allocate 63.750244MB memory on GPU 8, 11.890381GB memory has been allocated and available memory is only 20.312500MB.

Please check whether there is any other process using GPU 8.
1. If yes, please stop them, or start PaddlePaddle on another GPU.
2. If no, please decrease the batch size of your model. 

 (at /paddle/paddle/fluid/memory/allocation/cuda_allocator.cc:79)
. (at /paddle/paddle/fluid/imperative/tracer.cc:192)



--------------------------------------
C++ Traceback (most recent call last):
--------------------------------------
0   paddle::framework::SignalHandle(char const*, int)
1   paddle::platform::GetCurrentTraceBackString[abi:cxx11]()

----------------------
Error Message Summary:
----------------------
FatalError: `Termination signal` is detected by the operating system.
  [TimeInfo: *** Aborted at 1622347526 (unix time) try "date -d @1622347526" if you are using GNU date ***]
  [SignalInfo: *** SIGTERM (@0x3e80000134a) received by PID 47325 (TID 0x7f3b0664d740) from PID 4938 ***]



--------------------------------------
C++ Traceback (most recent call last):
--------------------------------------
0   paddle::framework::SignalHandle(char const*, int)
1   paddle::platform::GetCurrentTraceBackString[abi:cxx11]()

----------------------
Error Message Summary:
----------------------
FatalError: `Termination signal` is detected by the operating system.
  [TimeInfo: *** Aborted at 1622347679 (unix time) try "date -d @1622347679" if you are using GNU date ***]
  [SignalInfo: *** SIGTERM (@0x3e80000134a) received by PID 44169 (TID 0x7fa101423740) from PID 4938 ***]

/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0530 12:09:15.848132  8712 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:37151 successful.
I0530 12:09:16.154624  8712 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0530 12:09:20.880196  8712 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0530 12:09:20.886507  8712 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.48s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 75, in _forward
    body_feats = self.backbone(self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/res2net.py", line 421, in forward
    res1 = self.res1(x)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/container.py", line 97, in forward
    input = layer(input)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/res2net.py", line 116, in forward
    out = self.conv(inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/nn/layer/conv.py", line 667, in forward
    use_cudnn=self._use_cudnn)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/nn/functional/conv.py", line 114, in _conv_nd
    pre_bias = getattr(core.ops, op_type)(x, weight, *attrs)
KeyboardInterrupt
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
usage: train.py [-h] [-c CONFIG] [-o [OPT [OPT ...]]]
                [--weight_type WEIGHT_TYPE] [--eval]
                [--slim_config SLIM_CONFIG] [--enable_ce ENABLE_CE]
                [--save_prediction_only]
train.py: error: unrecognized arguments: pretrain_weights=output/cascade_rcnn_res2net_r50_fpn_1x_coco_bfp_blio/8.pdparams
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0530 22:46:05.634622 37480 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:52151 successful.
I0530 22:46:06.115628 37480 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0530 22:46:09.881413 37480 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0530 22:46:09.888825 37480 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.42s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0531 09:28:47.912686 41284 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:53301 successful.
I0531 09:28:48.399183 41284 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0531 09:28:54.667443 41284 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0531 09:28:54.675845 41284 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.48s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 75, in _forward
    body_feats = self.backbone(self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/res2net.py", line 425, in forward
    x = stage(x)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/res2net.py", line 285, in forward
    return self.blocks(inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/container.py", line 97, in forward
    input = layer(input)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/res2net.py", line 222, in forward
    out = self.branch2a(inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/res2net.py", line 129, in forward
    out = getattr(F, self.act)(out)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/nn/functional/activation.py", line 491, in relu
    return core.ops.relu(x)
KeyboardInterrupt
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0531 09:44:38.947067  5358 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:55461 successful.
I0531 09:44:39.257393  5358 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0531 09:44:43.513590  5358 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0531 09:44:43.521566  5358 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.43s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0531 18:32:11.434722 20607 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:48151 successful.
I0531 18:32:11.520865 20607 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0531 18:32:14.496209 20607 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0531 18:32:14.502132 20607 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.42s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 80, in _forward
    rois, rois_num, rpn_loss = self.rpn_head(body_feats, self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/proposal_generator/rpn_head.py", line 109, in forward
    anchors = self.anchor_generator(rpn_feats)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/proposal_generator/anchor_generator.py", line 100, in forward
    anchors_over_all_feature_maps = self._grid_anchors(grid_sizes)
  File "/home/lthpc/clw/ppdet/modeling/proposal_generator/anchor_generator.py", line 89, in _grid_anchors
    self.offset)
  File "/home/lthpc/clw/ppdet/modeling/proposal_generator/anchor_generator.py", line 76, in _create_grid_offsets
    offset * stride, grid_width * stride, step=stride, dtype='float32')
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/math_op_patch.py", line 206, in __impl__
    return scalar_method(self, other_var)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/math_op_patch.py", line 169, in _scalar_mul_
    return _scalar_elementwise_op_(var, value, 0.0)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/math_op_patch.py", line 109, in _scalar_elementwise_op_
    return core.ops.scale(var, 'scale', scale, 'bias', bias)
KeyboardInterrupt
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0531 19:25:05.417145  8203 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:57579 successful.
I0531 19:25:05.898208  8203 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0531 19:25:08.208936  8203 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0531 19:25:08.216683  8203 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.43s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0601 09:25:44.380208 22308 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:54815 successful.
I0601 09:25:44.817813 22308 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0601 09:25:49.778158 22308 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0601 09:25:49.785377 22308 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.44s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 75, in _forward
    body_feats = self.backbone(self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/res2net.py", line 421, in forward
    res1 = self.res1(x)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/container.py", line 97, in forward
    input = layer(input)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/res2net.py", line 116, in forward
    out = self.conv(inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/nn/layer/conv.py", line 667, in forward
    use_cudnn=self._use_cudnn)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/nn/functional/conv.py", line 114, in _conv_nd
    pre_bias = getattr(core.ops, op_type)(x, weight, *attrs)
KeyboardInterrupt
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0601 16:28:33.085952  4688 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:45503 successful.
I0601 16:28:33.218349  4688 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0601 16:28:37.493753  4688 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0601 16:28:37.500701  4688 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.51s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 75, in _forward
    body_feats = self.backbone(self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/res2net.py", line 421, in forward
    res1 = self.res1(x)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/container.py", line 97, in forward
    input = layer(input)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/res2net.py", line 127, in forward
    out = self.norm(out)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/nn.py", line 1342, in forward
    mean_out, variance_out, *attrs)
KeyboardInterrupt
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0601 16:29:29.060088  6260 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:44687 successful.
I0601 16:29:29.753736  6260 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0601 16:29:33.794874  6260 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0601 16:29:33.805032  6260 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.46s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
ERROR:root:DataLoader reader thread raised an exception!
Exception in thread Thread-1:
Traceback (most recent call last):
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dataloader/dataloader_iter.py", line 482, in _get_data
    data = self._data_queue.get(timeout=self._timeout)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/multiprocessing/queues.py", line 105, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dataloader/dataloader_iter.py", line 411, in _thread_loop
    batch = self._get_data()
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dataloader/dataloader_iter.py", line 498, in _get_data
    "pids: {}".format(len(failed_workers), pids))
RuntimeError: DataLoader 2 workers exit unexpectedly, pids: 6955, 6957

/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0601 16:41:01.035748 16478 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:52733 successful.
I0601 16:41:01.186211 16478 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0601 16:41:05.201062 16478 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0601 16:41:05.211926 16478 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.46s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 80, in _forward
    rois, rois_num, rpn_loss = self.rpn_head(body_feats, self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/proposal_generator/rpn_head.py", line 120, in forward
    loss = self.get_loss(scores, deltas, anchors, inputs)
  File "/home/lthpc/clw/ppdet/modeling/proposal_generator/rpn_head.py", line 200, in get_loss
    anchors)
  File "/home/lthpc/clw/ppdet/modeling/proposal_generator/target_layer.py", line 48, in __call__
    batch_size)
  File "/home/lthpc/clw/ppdet/modeling/proposal_generator/target.py", line 41, in rpn_anchor_target
    anchors, gt_bbox, rpn_positive_overlap, rpn_negative_overlap, True)
  File "/home/lthpc/clw/ppdet/modeling/proposal_generator/target.py", line 79, in label_box
    iou > 0, iou == highest_quality_foreach_gt).cast('int32').sum(
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/layers/nn.py", line 12194, in logical_and
    op_name="logical_and", x=x, y=y, name=name, out=out, binary_op=True)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/layers/nn.py", line 12133, in _logical_op
    return op(x, y)
KeyboardInterrupt
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0601 16:44:25.336352 20055 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:52751 successful.
I0601 16:44:25.702558 20055 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0601 16:44:29.746994 20055 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0601 16:44:29.754788 20055 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.44s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 302, in train
    loss.backward()
  File "<decorator-gen-123>", line 2, in backward
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/wrapped_decorator.py", line 25, in __impl__
    return wrapped_func(*args, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/framework.py", line 225, in __impl__
    return func(*args, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/varbase_patch_methods.py", line 236, in backward
    framework._dygraph_tracer())
OSError: (External) ResourceExhaustedError: 

Out of memory error on GPU 9. Cannot allocate 152.437744MB memory on GPU 9, 11.859131GB memory has been allocated and available memory is only 52.312500MB.

Please check whether there is any other process using GPU 9.
1. If yes, please stop them, or start PaddlePaddle on another GPU.
2. If no, please decrease the batch size of your model. 

 (at /paddle/paddle/fluid/memory/allocation/cuda_allocator.cc:79)
 (at /paddle/paddle/fluid/imperative/basic_engine.cc:487)

/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0601 16:50:29.609153 25571 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:43591 successful.
I0601 16:50:29.953650 25571 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0601 16:50:33.046900 25571 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0601 16:50:33.055640 25571 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.49s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0602 09:07:33.841154 37463 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:41319 successful.
I0602 09:07:34.418579 37463 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0602 09:07:38.695969 37463 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0602 09:07:38.702037 37463 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.42s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
Traceback (most recent call last):
  File "tools/train.py", line 123, in <module>
    main()
  File "tools/train.py", line 119, in main
    run(FLAGS, cfg)
  File "tools/train.py", line 98, in run
    trainer.train(FLAGS.eval)
  File "/home/lthpc/clw/ppdet/engine/trainer_v1.py", line 299, in train
    outputs = model(data)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/parallel.py", line 578, in forward
    outputs = self._layers(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/architectures/meta_arch.py", line 23, in forward
    out = self.get_loss()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 113, in get_loss
    rpn_loss, bbox_loss, mask_loss = self._forward()
  File "/home/lthpc/clw/ppdet/modeling/architectures/cascade_rcnn.py", line 75, in _forward
    body_feats = self.backbone(self.inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/res2net.py", line 425, in forward
    x = stage(x)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/res2net.py", line 285, in forward
    return self.blocks(inputs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/container.py", line 97, in forward
    input = layer(input)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/res2net.py", line 235, in forward
    out = self.branch2c(paddle.concat(out_split, 1))
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/clw/ppdet/modeling/backbones/res2net.py", line 127, in forward
    out = self.norm(out)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/layers.py", line 898, in __call__
    outputs = self.forward(*inputs, **kwargs)
  File "/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/fluid/dygraph/nn.py", line 1342, in forward
    mean_out, variance_out, *attrs)
KeyboardInterrupt
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
I0602 10:08:36.022541 32724 gen_comm_id_helper.cc:181] Server listening on: 127.0.0.1:43799 successful.
I0602 10:08:36.330361 32724 nccl_context.cc:74] init nccl context nranks: 4 local rank: 3 gpu id: 9 ring id: 0
W0602 10:08:42.089305 32724 device_context.cc:404] Please NOTE: device: 9, GPU Compute Capability: 6.1, Driver API Version: 11.2, Runtime API Version: 10.2
W0602 10:08:42.101634 32724 device_context.cc:422] device: 9, cuDNN Version: 7.6.
/home/lthpc/anaconda3/envs/ShawnD/lib/python3.7/site-packages/paddle/tensor/creation.py:125: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe. 
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
  if data.dtype == np.object:
loading annotations into memory...
Done (t=0.43s)
creating index...
index created!
Illegal image file: datasets/camera_0525/mytrain/09269_2.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_4.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_6.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_8.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09171_9.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/10029_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/09217_10.jpg, and it will be ignored
Illegal image file: datasets/camera_0525/mytrain/18941_10.jpg, and it will be ignored
Found an invalid bbox in annotations: im_id: 7609, area: 0.0 x1: 387.0, y1: 113.0, x2: 391.0, y2: 113.0.
Found an invalid bbox in annotations: im_id: 8206, area: 0.0 x1: 552.0, y1: 54.0, x2: 553.0, y2: 54.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 301.0, y1: 398.0, x2: 303.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 9019, area: 0.0 x1: 298.0, y1: 398.0, x2: 305.0, y2: 398.0.
Found an invalid bbox in annotations: im_id: 12643, area: 0.0 x1: 1091.0, y1: 26.0, x2: 1092.0, y2: 26.0.
Found an invalid bbox in annotations: im_id: 13527, area: 0.0 x1: 615.0, y1: 135.0, x2: 616.0, y2: 135.0.
